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APPLICATION SERVER FOR SELF-DOCUMENTING 
VOICE ENABLED WEB APPLICATIONS DEFINED USING 
EXTENSIBLE MARKUP LANGUAGE DOCUMENTS 

CROSS REFERENCE TO RELATED APPLICATIONS 

This application claims priority from provisional application No. 60/152,316, filed 
September 3, 1999, the disclosure of which is incorporated in its entirety herein by reference. 

BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

The present invention relates to generating and executing voice enabled web applications 
within a hypertext markup language (HTML) and hypertext transport protocol (HTTP) framework. 

DESCRIPTION OF TH E RELATED ART 

The evolution of the public switched telephone network has resulted in a variety of voice 
applications and service:; that can be provided to individual subscribers and business subscribers. 
Such services include voi ce messaging systems that enable landline or wireless subscribers to record, 
playback, and forward voice mail messages. However, the ability to provide enhanced services to 
subscribers of the public switched telephone network is directly affected by the limitations of the 
public switched telephone network. In particular, the public switched telephone network operates 
according to a protocol that is specifically designed for the transport of voice signals; hence any 
modifications necessary to provide enhanced services can only be done by switch vendors that have 
sufficient know-how of the existing public switched telephone network infrastructure. 

An open standards-based Internet protocol (IP) network, such as the World Wide Web, the 
Internet, or a corporate intranet, provides client-server type application services for clients by 
enabling the clients to request application services from remote servers using standardized protocols, 
for example hypertext transport protocol (HTTP). The web server application environment can 
include web server software, such as Apache, implemented on a computer system attached to the IP 
network. Web-based applications are composed of HTML pages, logic, and database functions. 
In addition, the web server may provide logging and monitoring capabilities. 
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In contrast to the public switched telephone network, the open standards-based IP network 
has enabled the proliferation of web based applications written by web application developers using 
ever increasing web development tools. Hence, the ever increasing popularity of web applications 
and web development tools provides substantial resources for application developers to develop 
robust web applications in a relatively short time and an economical manner. However, one 
important distinction between telephony-based applications and web-based applications is that 
telephony-based applications are state aware, whereas web-based applications are stateless. 

In particular, telephony applications are state aware to ensure that prescribed operations 
between the telephony application servers and the user telephony devices occur in a prescribed 
sequence. For example, operations such as call processing operations, voicemail operations, call 
forwarding, etc., require that specific actions occur in a specific sequence to enable the multiple 
components of the publi: switched telephone network to complete the prescribed operations. 

The web-based asplications running in the IP network, however, are state-less and transient 
in nature, and do not maintain application state because application state requires an interactive 
communication between the browser and back-end database servers accessed by the browsers via 
a HTTP-based web server. However, an HTTP server provides asynchronous execution of HTML 
applications, where the web applications in response to reception of a specific request in the form 
of a URL from a client, instantiate a program configured for execution of the specific request, send 
an HTML web page badk to the client, and terminate the program instance that executed the specific 
request. Storage of appL cation state information in the form of a "cookie" is not practical because 
some users prefer not to enable cookies on their browser, and because the passing of a large amount 
of state information as would normally be required for voice-type applications between the browser 
and the web application would substantially reduce the bandwidth available for the client. 

Commonly-assigned, copending application serial no. 09/501,516, filed February 1, 2000 
entitled Arrangement for Defining and Processing Voice Enabled Web Applications Using 
Extensible Markup Language Documents (attorney docket 95-410), the disclosure of which is 
incorporated in its entirety herein by reference, discloses an arrangement for defining a voice- 
enabled web application using extensible markup language (XML) documents that define the voice 
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application operations 1o be performed within the voice application. Each voice application 
operation can be defined as any one of a user interface operation, a logic operation, or a function 
operation. Each XML document includes XML tags that specify the user interface operation, the 
logic operation and/or the function operation to be performed within a corresponding voice 
application operation, the XML tags being based on prescribed rule sets that specify the executable 
functions to be performed by the application runtime environment. Each XML document may also 
reference another XML document to be executed based on the relative position of the XML 
document within the sequence of voice application operations to be performed. The XML 
documents are stored for execution of the voice application by an application server in an application 
runtime environment. 

The application server disclosed in the above-incorporated application 09/501 ,5 16 executes 
the voice-enabled web application by runtime execution of the extensible markup language (XML) 
documents that define the voice-enabled web application to be executed. The application server 
includes a runtime environment that establishes an efficient, high-speed connection to a web server. 
The application server, i i response to receiving a user request from a user, accesses a selected XML 
page that defines at least a part of the voice application to be executed for the user. The XML page 
may describe any one of a user interface such as dynamic generation of a menu of options or a 
prompt for a password, ;in application logic operation, or a function capability such as generating 
a function call to an ex;ernal resource. The application server then parses the XML page, and 
executes the operation described by the XML page, for example dynamically generating an HTML 
page having voice applic ition control content, or fetching another XML page to continue application 
processing. In addition, 1 he application server may access an XML page that stores application state 
information, enabling the application server to be state-aware relative to the user interaction. 

Hence, web programmers can write voice-enabled web applications, using the teachings of 
the above-incorporated application serial number 09/501,516, by writing XML pages that specify 
respective voice application operations to be performed. The XML documents have a distinct 
feature of having tags that allow a web browser (or other software) to identify information as being 
a specific kind or type o f information. 
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One recurring problem in application development is the necessity for documenting 
applications. In particular, documentation of voice applications (e.g., code-level functional call 
flows, user-level call flows, prompt sequences and listings, user input requirements, etc.) has 
typically been a manual process undertaken by a combination of product managers, software 
developers, and testers. Due to the manual nature of defining the application, creating the 
application, and documenting the application, the process tends to the error prone. The manual 
process typically results in incomplete documentation, for example due to the product being released 
and shipped before the product is fully documented. 

The manual documentation process has been a necessity because many voice applications 
are written in general-p orpose programming languages, and because the interface (e.g., menus, 
prompt, user input requirements) are inseparable from the code. In view of the complex rules 
surrounding the written code, it becomes very difficult to determine what information is useful for 
the documentation process, and what information is extraneous. 



SUMMARY OF THE INVENTION 

There is a need for an arrangement that enables voice applications to be documented based 
on interpretation of application-defining parameters by an application server. In particular, there is 
a need for arrangement that enables generation of documentation for voice applications, where an 
application server configured for executing a voice application also can extract documentation 
parameters for creating and formatting documentation for the voice application. 

These and other needs are attained by the present invention, where an application server, 
configured for executing a voice application defined by XML documents, is configured for 
describing the voice application by collecting, for each of the XML documents, attributes describing 
execution of the XML documents in an application runtime environment, and generating for storage 
on a tangible medium ar output file that describes the voice application based on at least a portion 
of the collected attributes selected by a user. 
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One aspect of the present invention provides a method in an application server configured 
for executing a voice application. The method includes parsing an extensible markup language 
(XML) document having XML tags for defining voice application operations, collecting attributes 
describing execution of the XML tags by the application server within an application runtime 
environment, and generating for storage on a tangible medium an output file that describes the voice 
application by outputting at least a portion of the collected attributes based on a user selection. Use 
of XML documents to define voice application operations enables the separation of user interface 
logic from application logic; hence, the parsing of XML tags enables the identification of attributes 
that describe the execution of the XML tags within the application runtime environment. These 
attributes are then collected for each XML document, enabling the application runtime environment 
to generate an output file that describes the voice application according to a format selected by a 
user. Hence, a user can request generation of documents that describe the voice application in any 
format, for example a relationship diagram that identifies interrelated XML documents and 
application functions, a user prompt menu to assist users navigating menu options generated by the 
voice application, a resource utilization table that specifies resources necessary for selected XML 
documents, and/or a call flow diagram that specifies the sequence of voice application operations. 

Another aspect of the present invention provides an application server including a storage 
medium configured for storing extensible markup language (XML) documents having XML tags that 
define voice application operations for a voice application, and an application runtime environment. 
The application runtime environment is configured for generating an output file that describes 
selected attributes of the voice application, and includes a parser configured for determining 
attributes of the respective XML tags within each of the XML documents according to the 
application runtime environment. The application runtime environment also includes a context 
collection module configured for storing the determined attributes, the application runtime 
environment selecting the stored determined attributes based on a user selection. Since the voice 
application operations aie defined by the XML documents, the XML parser can identify attributes 
of the voice application, for example the relationship of operations specified by the XML tags to 
resources, procedures, and other XML documents accessible by the application runtime 
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environment. Hence, this application runtime environment can generate an output file in any user- 
selectable format that describes any desired attribute of the voice application defined by XML 
documents. 

Additional advantages and novel features of the invention will be set forth in part in the 
description which follows and in part will become apparent to those skilled in the art upon 
examination of the following or may be learned by practice of the invention. The advantages of the 
present invention may be realized and attained by means of instrumentalities and combinations 
particularly pointed out in the appended claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Reference is made to the attached drawings, wherein elements having the same reference 
numeral designations represent like elements throughout and wherein: 

Figure 1 is a block diagram illustrating an architecture system enabling execution and 
documentation of voice enabled web applications according to an embodiment of the present 
invention. 

Figure 2 is a diagram illustrating development tools usable for development of the voice 
enabled web applications. 

Figures 3 A and 3B are diagrams illustrating in further detail the application server of Figure 

2. 

Figure 4 is a diagram illustrating a conventional arrangement of defining an application using 
executable code. 

Figure 5 is a diagram illustrating XML-type documents, and associated resources and 
procedures, used to define the application described with respect to Figure 4 

Figure 6 a diagram illustrating a relationship diagram describing the application specified 
by the XML-type documents of Figure 5 and generated by the application server of Figure 3 
according to an embodiment of the present invention. 
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Figure 7 is a diag -am illustrating the method by the application server of generating an output 
file that describes the vcice application according to an embodiment of the present invention. 



BEST MODE FOR CARRYING OUT THE INVENTION 
Figure 1 is a bloc £ diagram illustrating an architecture that provides unified voice messaging 
services and data services via an IP network using browser audio control according to an 
embodiment of the present invention, reproduced from Figure 3 of the above-incorporated 
application 09/501,516. The clients 42a and 42b, referred to herein as "fat clients" and "thin 
clients", respectively, have the distinct advantage that they can initiate requests using IP protocol 
to any connected web server 64 to execute part or most of the applications 44 on behalf of the 
clients. An example of a fat client 42a is an e-mail application on a PC that knows how to run the 
application 44 and knows how to run the IP protocols to communicate directly with the messaging 
server via the packet switched network 50. An example of a thin client 42b is a PC that has a web 
browser; in this case, the web browser 56 can use IP protocols such as HTTP to receive and display 
web pages generated according to hypertext markup language (HTML) from server locations based 
on uniform resource locators (URLs) input by the user of the PC. 

As shown in Figure 1, each of the clients (tiny clients, skinny clients, thin clients and fat 
clients) are able to communicate via a single, unified architecture 60 that enables voice 
communications services between different clients, regardless of whether the client actually has 
browser capabilities. Hence, the fat client 42a and the thin client 42b are able to execute voice 
enabled web applicatiors without any hardware modification or any modification to the actual 
browser; rather, the browsers 56 in the clients 42a and 42b merely are provided with an executable 
voice resource configured for providing browser audio control, described below. 

The user devices 1 8a, 1 8b, and 1 8c, illustrated as a cordless telephone 1 8a, a fax machinel 8b 
having an attached teleph one, and an analog telephone 1 8c, are referred to herein as "skinny clients", 
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defined as devices that are able to interface with a user to provide voice and/or data services (e.g., 
via a modem) but cannot perform any control of the associated access subnetwork. 

The wireless user devices 1 8d, 1 8e, and 1 8f, illustrated as a cellular telephone (e.g., AMPS, 
TDMA, or CDMA) 1 8d, a handheld computing device (e.g., a 3-Com Palm Computing or Windows 
CE-based handheld device) 18e, and a pager 18f, are referred to as tiny clients. "Tiny clients" are 
distinguishable from skinny clients in that the tiny clients tend to have even less functionality in 
providing input and output interaction with a user, rely exclusively on the executable application in 
an access subnetwork to initiate communications; in addition, tiny clients may not be able to send 
or receive audio signals such as voice signals at all. 

Hence, the skinny clients 18a, 18b, and 18c and the tiny clients 18d, 18e, and 18f access the 
unified voice messaging services in the unified network 60 via a proxy browser 62, configured for 
providing an IP and HTTP interface for the skinny clients and the tiny clients. In particular, 
browsers operate by interpreting tags within a web page supplied via an HTTP connection, and 
presenting to a user media content information (e.g., text, graphics, streaming video, sound, etc.) 
based on the browser capabilities; if a browser is unable to interpret a tag, for example because the 
browser does not have the appropriate executable plug-in resource, then the browser typically will 
ignore the unknown tag. Hence, the proxy browser 62 can provide to each of the skinny clients and 
tiny clients the appropriate media content based on the capabilities of the corresponding client, such 
that the cordless telephone 1 8a and telephone 1 8c would receive analog audio signals played by the 
proxy browser 62 and no text information (unless a display is available); the fax machine 18b and 
pager 1 8f would only rec eive data/text information, and the cellular telephone 1 8d and the handheld 
computing device 1 8e would receive both voice and data information. Hence, the proxy browser 62 
interfaces between the IP network and the respective local access devices for the skinny clients and 
the tiny clients to provide access to the unified messaging network 60. 

The proxy brows er 62 and the web browsers 56 within the fat client 42a and the thin client 
42b execute voice enabled web applications by sending data and requests to a web server 64, and 
receiving hypertext markup language (HTML) web pages from the web server 64, according to 
hypertext transport protocol (HTTP). The web server 64 serves as an interface between the browsers 
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and an application server 66 that provides an executable runtime environment for XML voice 
applications 68. For example, the web server 64 may access the application server 66 across a 
common gateway interface (CGI), by issuing a function call across an application programming 
interface (API), or by requesting a published XML document or an audio file requested by one of 
the browsers 56 or 62. The application server 66, in response to receiving a request from the web 
server 64, may either supply the requested information in the form of an HTML page having XML 
tags for audio control by a voice resource within the browser, or may perform processing and return 
a calculated value to enable the browser 56 or 62 to perform additional processing. 

The application server 66 accesses selected stored XML application pages (i.e., pages that 
define an application) an i in response generates new HTML pages having XML tags during runtime 
and supply the generated HTML pages having XML tags to the web server 64. Since multiple 
transactions may need to occur between the browser 56 or 62 and the application server 66, the 
application server 66 is configured for storing for each existing user session a data record, referred 
to as a "brownie", that icentifies the state of the existing user session; hence, the application server 
66 can instantiate a procedure, return the necessary data, and terminate the procedure without the 
necessity of maintaining the instance running throughout the entire user session. 

Hence, the application server 66 executes voice application operations from a stored XML 
document based on a transient application state, where the application server 66 terminates the 
application instance after outputting the generated XML media information to the browser 1 8 or 42. 

Figure 2 is a diagram illustrating development tools usable for development of the voice 
enabled web applications. As shown in Figure 2, the web server 64, the application server 66, and 
the voice web applications 68 reside within a gateserver 70. The gateserver 70 provides HTTP 
access for a browser based XML editor tool 56b that enables a web programmer to design voice 
applications by editing XML pages. The XML pages are stored as XML applications and functions 
72, for example within a database accessible by the application server 66. The XML pages stored 
within the XML applicaiion and functions database 72 define the actual application operations to 
be performed by the application server 66 in its application runtime environment. Hence, the 
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application server 66 executes stored XML applications and functions 72, and in response generates 
dynamic HTML pages having XML tags, also referred to as HTML/XML pages 74. 

Certain developrient tools having direct access to the application server 66 can be used to 
establish context information used by the application runtime environment within the application 
server 66 for execution application operations based on parsing of XML documents. In particular, 
development tools such as a graphic based development system 80a, a forms-based development 
system 80b, an editor-based development system 80c, or an outline-based development system 80d 
may be used to define XML tags and procedure calls for the application runtime environment. The 
development tools 80 may be used to establish an application and resource database 84 to define 
low-level operations for prescribed XML tags, for example dynamically generating an XML menu 
page using executable functions specified by a menu rule set in response to detecting a menu tag, 
performing a logical operation using executable functions specified by a logic rule set in response 
to a decision tag, or fetching an audio (,wav) file in response to detecting a sound tag. 

The development tools 80 may be used to establish an application programming interface 
(API) library 112 (e.g., a SQL interface) for the application runtime environment, enabling the 
application server 66 to issue prescribed function calls to established services, such as IMAP, LD AP, 
or SMTP. The library 112 may be implemented as dynamically linked libraries (DLLs) or 
application programming interface (API) libraries. 

Figures 3A and 3B are diagrams illustrating in detail the application server 66. The 
application server 66 is mplemented as a server executing a PHP hypertext processor with XML 
parsing and processing capabilities, available open source at http://www.php.net. As shown in 
Figure 3 A, the server system 66 executes an application runtime environment 100 that includes an 
XML parser 102 configured for parsing the application-defining XML documents (e.g., XML 
document 1 00) stored in the XML document database 72, or the XML documents (i.e., "brownies") 
stored in the registry 92 and configured for specifying the state and attributes for respective user 
sessions. The application server 66 also includes a high speed interface 104 that establishes a 
high-speed connection between the application server 66 and the web server 64. For example, the 
PHP hypertext processo * includes a high-speed interface for Apache Web servers. 
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The runtime env . raiment 100 is configured for execution of the parsed XML documents. 
The runtime environment 100 includes a tag implementation module 106 that implements the XML 
tags parsed by the XML parser 102. The tag implementation module 106 performs relatively 
low-level operations for execution of user interface operations, logic operations, or procedure calls. 
In particular, the tag implementation module 1 06 includes an executable tag resource library 1 08 that 
includes executable routines for selected XML tags (e.g., selected XML tags implemented using 
executable code such a;; C), which may be instantiated during initialization of the application 
runtime environment 100, or as needed upon execution of the corresponding XML tag operation. 
The tag implementatior module 106 also includes an XML tag list 110 that "describes" the 
corresponding operatior by specifying any logical operation, resource, procedure call etc. to 
implement the correspor ding tag. 

Hence, the tag implementation module 106 enables implementation of the XML tags within 
the context of the application runtime environment 100. For example the tag implementation 
module 106 dynamically generates an XML menu page using executable functions specified by a 
menu rule set in response to detecting a menu tag, performs a logical operation using executable 
functions specified by a logic rule set in response to a decision tag, or fetches an audio (.wav) file 
in response to detecting a an XML tag specifying an audio file as a resource. Hence, the tag 
implementation module 106 implements the tag operations that are specified within the XML 
framework of the stored XML documents, performing any one of a user interface operation, a logic 
operation, or a procedure call as specified by the parsed XML document by executing a 
corresponding set of executable functions based on the rule set (specified by the executable tag 
resource library 108 or the XML tag list 110) for the corresponding operation. 

The application runtime environment 100 also includes a voice prompts resource directory 
114 that specifies the location of resources, such as .wav files, specified in the XML documents. 
Hence, the voice prompts resource directory 1 14 enables the application runtime environment 100 
to access, either locally or remotely, stored .wav files used as voice prompts specified in the XML 
documents. Each voice prompt may also include corresponding text data that specifies the contents 
of the corresponding voice prompt: the text data may be stored within the header of the voice 
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prompt, may be stored as a separate text file linked to the .wav file, or may be integrated within the 
.wav file itself. 

The application server 66 also includes a set of libraries 112 that may be implemented as 
dynamically linked libniries (DLLs) or application programming interface (API) libraries. The 
libraries 1 12 enable the rantime environment 100 to implement the procedures as specified by the 
appropriate XML docum ent. For example, the application server 66 may issue a function call to one 
of a plurality of IP pro .ocol compliant remote resources 240, 242, or 244 according to IMAP 
protocol, LDAP Protocol, or SMTP protocol, respectively. For example, the PHP hypertext 
processor includes executable routines capable of accessing the IMAP or LDAP services, where the 
XML tags that reference those services are defined in the tag implementation module 106 (e.g., as 
executable code in the executable resource library 108 or rule sets within the XML tag list 1 10). 
Note that the mechanisms for accessing the services 240, 242, or 244 should be established within 
the library 1 12 before uss of XML documents that reference those services. Once the mechanisms 
for accessing the services 240, 242, or 244 are established in the library 1 1 2 , the application runtime 
environment 100 can perform a function operation by using executable functions specified by a 
function call rule set in the tag implementation module 106. 

As described abo ve, the tag implementation module 1 06 specifies the rule sets for XML tags, 
enabling specific operations to be performed for each parsed XML tag, within the context of the 
application runtime environment 100. For example, the tag implementation module 106 includes 
rule sets that define four 1 ypes of XML documents used by the application server 66 to execute web- 
based voice applications: menu documents, activity documents, decision documents, and 
"brownies". The menu documents, activity documents, and decision documents are XML 
documents, stored in the document database 72, that define user interface and boolean-type 
application logic for a web application, hence are considered "executable" by the application server 
66. The brownie document, stored in a separate registry 92, is an XML data record used to specify 
application state and user attribute information for a given XML application during a user session. 
Hence, the XML documents define user interface logistics and tie services and application server 
events together in a meaningful way, forming a coherent application or sets of applications. 
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Additional details regarding the definition of executable voice applications using XML documents 
are described in the above-incorporated application 09/501,516. 

The disclosed em bodiment directed to an arrangement that generates documents that describe 
voice-enabled web applications based on interpreting the XML documents that define the voice- 
enabled web application operations within the context of the application runtime environment 100. 
The application runtime environment 100 includes a context collection module 1 16 and an output 
module 124, illustrated in detail in Figure 3B. The context collection module 1 16 is configured for 
storing XML tag attributes determined by the parser 102 based on context information derived from 
the tag implementation module 106 within the application runtime environment 100. The context 
collection module 116 includes a resource collection table 118 configured for storing resources 
determined by the XML parser 1 02 to be referenced by a corresponding parsed XML document. The 
context collection mod ale 116 also includes an executable procedures collection table 120, 
configured for storing executable procedures (e.g., procedure calls to the procedures library 112) 
referenced by the corresponding parsed XML document. The context collection module 116 also 
includes a possible next states collection table configured for storing possible next states of the voice 
application as specified by the corresponding parsed XML document. Each of the tables 1 1 8, 1 20, 
and 122 also are configured for storing the attributes on a per-XML document basis. Hence, each 
application-defining XM L document has its own corresponding entry in the tables 1 1 8, 1 20, and 1 22 
for storing of the corresponding attributes. 

Hence, the structured nature of XML documents that permits voice-enabled web applications 
to be executed by the application runtime environment 100 based on a prescribed set of rules also 
enables the application runtime environment 100 to generate a document that identifies the 
relationships between XI AL documents, based on user selection and based on the attributes collected 
within the context collection module 1 16 for each of the XML documents. 

The application r ontime environment 1 00 also includes an output module 1 24 configured for 
generating the output document file based on the user selection. In particular, the output module 1 24 
includes scripts for generating documents that describe the voice application according to prescribed 
output formats. The output module 124 also is configured for accessing selected attributes from the 
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tables 118, 120 and 122 for selected XML documents using a sequential or recursive technique, 
depending on the type of output format. Exemplary output formats include: a user prompt menu that 
enables a user to follow a sequence of prompts within the menu structure specified by the XML 
documents; a resource utilization table that identifies all the resources within the voice prompts 
resources directory 1 14 lhat are used by selected XML documents, and/or graphic output format for 
diagrams such as a call flow diagram. Hence, the output module 124 accesses selected attributes 
from the context collection module 1 16, depending on the type of output format desired by the user. 

An understanding of the self-documenting nature of XML documents will become more 
readily apparent from the following description of Figures 4, 5 and 6. Figure 4 is a diagram 
illustrating an implementation 400 of a relatively simple program entitled "Hello World" written 
using an executable code. One needs a detailed understanding of the programming language used 
for the implementation 400 to even begin deciphering the flow of the application. In contrast, 
defining the application using a set of documents 402 and 404, illustrated in Figure 5 within the 
context of an application runtime environment 406 that specifies a simple set of rules relating the 
documents 402 and 404, enables the generation of a directed graph 408, illustrated in Figure 6, from 
which various forms of documentation can be extracted. 

Figure 5 illustrates documents 402 and 404, which are used to define application operations 
using prescribed functions within an application runtime environment 406. The documents 402 and 
404 as illustrated are not actual XML documents according to XML format, but illustrate document 
tags (that can be written in XML) that specify application operations to be executed by the 
application runtime env ronment 406. The application runtime environment 406 is a simplified 
representation of the XML-based application runtime environment 100 for ease of illustration, but 
is intended to include all ihe functionality of the application runtime environment 1 00 described with 
respect to Figure 3 A. For example, document 402 ("Document A") and document 404 ("Document 
B") each specify a default voice prompt tag from available voice resources 410 to be played for a 
user, an input type tag that specifies the expected input to be validated, an input verification tag that 
specifies a procedure call to aprescribed function 412 for verification of the user input, decision tags 
("returnval") that specify an action to be performed based on the value returned by the called 
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procedure, and action tags ("onsuccess" and "onfailure") that specify the next document to be 
executed based on the application runtime environment 406 determining a result of the user input. 
More specific examples of identifying voice application operations using tags specifically 
implemented in XML a-e described with respect to Figures 8 A to 8E in the above-incorporated 
application 09/501,516. 

In contrast to the code-implemented application 400, the documents 402 and 404 separate 
logic from functions and user interface. Hence, the call flow relationship diagram 408 can be 
generated based on parsing the documents 402 and 404, and explicitly specifying the relationships 
between the tags within the documents 402 and 404, the resources 410, and the function calls 412 
that are established during execution by the application runtime environment 406. Moreover, the 
call flow relationship diagram 408 can be generated by the application runtime environment 406 
without parsing or examination of the underlying executable code used to execute the tags within 
the documents 402 or 404. 

Figure 7 is a diagram illustrating the method of describing a voice application defined by 
XML documents according to an embodiment of the present invention. The steps described in 
Figure 7 can be impleme ited as executable code that is stored on a computer readable medium (e.g., 
a hard disk drive, a floppy drive, a random access memory, a read only memory, an EPROM, a 
compact disk, etc). 

The method begins in step 420, where the application runtime environment 1 00 is initialized 
by loading runtime variables such as resource locators from the voice resource directory 1 14, library 
registration parameters for the procedures library 1 12, and prescribed XML tag executable routines 
and/or XML tag defmit ons from the tag implementation module 106. The application runtime 
environment 100, having loaded the necessary runtime variables for execution of XML tags within 
the context of the application runtime environment, receives from a user in step 422 a self-document 
request that specifies a prescribed format, for example a user prompt menu, a resource utilization 
table, a call flow diagram, etc.. Typically the request may specify either a single XML document, 
or may specify a prescribed sequence of voice application operations. The application runtime 
environment 100 accesses in step 424 the documents related to the request that sequence of voice 
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application operations, for example by identifying the application state specified in the user's 
brownie (stored in the registry 92) if the XML document is not specifically identified in the user 
request. 

The XML parser 1 02 within the application runtime environment 1 00 then parses in step 426 
the XML tags in the referenced XML document, and interprets the XML tags based on the context- 
specific rule sets specified by the tag implementation module 106. 

The parser 102 then identifies the resources, for example the voice resources 410, that are 
referenced by the parsed XML document in step 428, and stores the identified resources within an 
entry for the corresponding parsed XML document in the resource collection table 118. The parser 
102 also identifies any procedure calls to the procedures library 1 12 specified in the parsed XML 
tags, for example procedures 412, and stores in step 430 the identified procedure calls within an 
entry for the correspondhg parsed XML document in the executable procedures collection table 120. 
The parser 102 also identifies other XML documents referenced as possible next states, and stores 
in step 432 the possible next states within an entry for the corresponding parsed XML document in 
the next states collection table 122. For example, the next states collection table entry for document 
402 ("Document A") would reference the documents 404 and 402, specified in the action tags 
"onsuccess" and "onfailure", respectively. 

Hence, the context collection module 1 1 6 stores the attributes of the parsed XML documents 
as explicit references tc resources, procedure calls, and possible next states that are otherwise 
implicit during execution of the XML documents during application runtime. Once the application 
runtime environment 100 has collected the attributes describing execution of the XML tags within 
an XML document, the; output module 124 is able to begin generation of the output file that 
describes the voice application, depending on the user selected output format in step 434 (e.g., if the 
output request specifies i text file that does not require state-dependent output generation). 

The application luntime environment 100 in step 436 accesses another XML document, if 
necessary, and repeats th ; process for collecting the attributes for the accessed XML document. For 
example, the application nintime environment 1 00 may access each of the XML documents specified 
in the next states collection table 122 for the first XML document entry. 
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Once the application runtime environment has collected the attributes for all relevant XML 
documents associated wiih a prescribed voice application operation, the output module 124 generates 
the output file by accessing selected attributes in step 43 8 from the collection table 1 1 8 , 1 20, and 1 22, 
and outputs the file in step 440, for example by storing as a text file, graphic file, etc. on a tangible 
medium or printing the document. As described above with reference to Figure 3B, the output 
module 124 selects collected attributes based on the type of documentation requested by the user. 

Hence, the outpu , module 1 24 may generate different types of output documents, for example 
the context relationship diagram illustrated in Figure 6, a menu call flow diagram, a list of default 
prompts, a list of all documents that reference the selected resource 410, a list of all resources (e.g., 
voice prompts) utilized by a selected XML document. 

Another example of the flexibility provided by the above-described arrangement involves 
an example where the keystroke *8 represents a transfer function for transferring the call outside a 
customer premises: assume that an administrator decides to no longer permit external transfers. The 
above-described arrangement could be used to generate two forms of documentation, the first 
identifying every user menu that used the *8 option, and the second specifying how to reach each 
of the user menus from jm initial entry state. 

According to the disclosed embodiment, voice applications defined by XML documents can 
be automatically documented based on user-selected requirements by parsing the XML documents, 
and collecting attributes describing execution of the XML tags of the XML documents within the 
application runtime environment. An output file can be generated that describes the voice 
application based on selecting the collected attributes based on user selection. Hence, the voice 
applications defined by XML documents can be considered as self-documenting, and the act of 
writing the applications using XML documents generates the necessary information for creating and 
formatting documentation in accordance with the attributes (i.e., context) provided by the 
application runtime environment. 

While this invenlion has been described in connection with what is presently considered to 
be the most practical and preferred embodiment, it is to be understood that the invention is not 
limited to the disclosed embodiments, but, on the contrary, is intended to cover various 
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modifications and equivalent arrangements included within the spirit and scope of the appended 
claims. 
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1. A method in an application server configured for executing a voice application, the 
method comprising: 

parsing an extensible markup language (XML) document having XML tags for defining 
voice application operations; 

collecting attributes describing execution of the XML tags by the application server within 
an application runtime environment; and 

generating for storage on a tangible medium an output file that describes the voice 
application by outputtin ? at least a portion of the collected attributes based on a user selection. 

2. The method cf claim 1, wherein the collecting step includes: 

identifying resources specified by the XML tags for selective execution based on respective 
specified conditions; and 

storing the identified resources in a resource collection table. 

3. The method cf claim 2, wherein the identified resources include sound files configured 
for storing voice prompts, the step of storing the identified resources including storing the name of 
the sound files. 

4. The method o 'claim 3, wherein the sound files are stored in .wav format, each sound file 
having a corresponding text field for storing a corresponding text prompt, the step of storing the 
identified resources furtfc er including storing the text prompt concurrently with the respective sound 
files. 

5. The method of claim 2, wherein the collecting step further includes: 

identifying executable procedures specified by the XML tags for selective execution based 
on the respective specified conditions; and 
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storing the identified executable procedures in an executable procedures collection table. 

6. The method of claim 5 5 wherein the step of identifying executable procedures includes 
identifying a procedure call to an external resource. 

7. The method of claim 5, wherein the collecting step further includes: 

identifying possible next states of the voice application specified by the XML tags based on 
the respective specified conditions; and 

storing the possible next states in a next states collection table. 

8. The method of claim 7, wherein the generating step includes selecting for the output file 
the attributes from at least one of the resource collection table, the executable procedures collection 
table, and the next states collection table, based on the user selection. 

9. The method of claim 8, wherein the generating step further includes selecting for the 
output file the attributes based on the user selection specifying one of a user prompt menu, a resource 
utilization table, and a call flow diagram. 

10. The method of claim 7, wherein the step of storing the possible next states includes 
storing within an entry of the next states collection table, corresponding to the XML document, the 
possible next states. 

1 1 . The method of claim 5, wherein the step of storing the identified executable procedures 
includes storing within an entry of the executable procedures collection table, corresponding to the 
XML document, the identified executable procedures. 

12. The method of claim 2, wherein the step of storing the identified resources includes 
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storing within an entry of the resource collection table, corresponding to the XML document, the 
identified resources. 

1 3 . The method of claim 1 , wherein the parsing step includes obtaining context information 
relative to the application runtime environment for each XML tag in the XML document. 

14. The method of claim 13, wherein the obtaining step includes: 
interpreting for each XML tag a corresponding operation; 

locating referenced XML documents that are specified within the XML tags; 
identifying referenced procedure calls that are specified within the XML tags; and 
locating resources specified within the XML tags. 

15. The method of claim 13, wherein the obtaining step includes interpreting each XML tag 
based on at least one of execution of a prescribed routine corresponding to said each XML tag and 
referencing of a tag list that specifies a corresponding operation for said each XML tag. 

16. An application server comprising: 

a storage medium configured for storing extensible markup language (XML) documents 
having XML tags that define voice application operations for a voice application; and 

an application runtime environment configured for generating an output file that describes 
selected attributes of the voice application, the application runtime environment having a parser 
configured for determining attributes of the respective XML tags within each of the XML documents 
according to the application runtime environment, and a context collection module configured for 
storing the determined attributes, the application runtime environment selecting the stored 
determined attributes ba sed on a user selection. 

17. The application server of claim 16, wherein the application runtime environment 
includes a tag implementation module configured for executing the respective voice application 
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operations specified by the XML tags, the tag implementation module having an executable library 
configured for storing executable routines for a first group of the XML tags, and a tag list that 
describes the voice application operations for a second group of the XML tags, the parser configured 
for determining the attributes based on the executable library and the tag list. 

18. The application server of claim 17, wherein the application runtime environment 
includes a resources directory configured for identifying respective locations of resources specified 
in the XML documents, the parser configured for determining the attributes based on the resources 
directory. 

19. The application server of claim 18, wherein the resources are stored as voice prompts, 
each voice prompt havir g audio data and text data specifying contents of the corresponding voice 
prompt. 

20. The application server of claim 18, wherein the application runtime environment 
includes a procedures library configured for specifying executable procedures configured for 
generating respective procedure calls to prescribed external resources, the parser configured for 
determining the attributes based on the procedures library. 

21. The applica:ion server of claim 20, wherein the context collection module includes: 

a resource collection table configured for storing the resources determined by the XML 
parser to be specified by a corresponding parsed XML document; 

an executable procedures collection table configured for storing the executable procedures 
determined by the XML parser to be specified by the corresponding parsed XML document; and 

a next states co [lection table configured for storing possible next states of the voice 
application determined by the XML parser to be specified by the corresponding parsed XML 
document, the application runtime environment selecting the stored determined attributes from the 
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resource collection table, the executable procedures collection table, and the next states collection 
table based on the user selection. 

22. The application server of claim 21 , wherein the application runtime environment further 
includes an output module configured for generating the output file as any one of a user prompt 
menu, a resource utilizalion table, and a call flow diagram, based on the user selection. 

23. A compute]* readable medium having stored thereon sequences of instructions for 
describing a voice application, the sequences of instructions including instructions for performing 
the steps of: 

parsing an extensible markup language (XML) document having XML tags for defining 
voice application operations; 

collecting attributes describing execution of the XML tags by the application server within 
an application runtime eavironment; and 

generating for storage on a tangible medium an output file that describes the voice 
application by outputting at least a portion of the collected attributes based on a user selection. 

24. The medium of claim 23, wherein the collecting step includes: 

identifying resources specified by the XML tags for selective execution based on respective 
specified conditions; and 

storing the identified resources in a resource collection table. 

25 . The medium of claim 24, wherein the identified resources include sound files configured 
for storing voice prompts, the step of storing the identified resources including storing the name of 
the sound files. 

26. The medium of claim 25, wherein the sound files are stored in .wav format, each sound 
file having a corresponding text field for storing a corresponding text prompt, the step of storing the 
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identified resources further including storing the text prompt concurrently with the respective sound 
files. 

27. The mediuir of claim 24, wherein the collecting step further includes: 
identifying executable procedures specified by the XML tags for selective execution based 

on the respective specified conditions; and 

storing the identified executable procedures in an executable procedures collection table. 

28. The medium of claim 27, wherein the step of identifying executable procedures includes 
identifying a procedure call to an external resource. 

29. The medium of claim 27, wherein the collecting step further includes: 
identifying possi sle next states of the voice application specified by the XML tags based on 

the respective specified conditions; and 

storing the possible next states in a next states collection table. 

30. The medium of claim 29, wherein the generating step includes selecting for the output 
file the attributes from at least one of the resource collection table, the executable procedures 
collection table, and the next states collection table, based on the user selection. 

3 1 . The medium of claim 30, wherein the generating step further includes selecting for the 
output file the attributes based on the user selection specifying one of a user prompt menu, a resource 
utilization table, and a call flow diagram. 

32. The medium of claim 29, wherein the step of storing the possible next states includes 
storing within an entry o f the next states collection table, corresponding to the XML document, the 
possible next states. 
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33. The medium of claim 27, wherein the step of storing the identified executable procedures 
includes storing within an entry of the executable procedures collection table, corresponding to the 
XML document, the identified executable procedures. 

34. The mediuir of claim 23, wherein the step of storing the identified resources includes 
storing within an entry of the resource collection table, corresponding to the XML document, the 
identified resources. 

35. The medivm of claim 23, wherein the parsing step includes obtaining context 
information relative to the application runtime environment for each XML tag in the XML 
document. 

36. The medium of claim 35, wherein the obtaining step includes: 
interpreting for each XML tag a corresponding operation; 

locating referenced XML documents that are specified within the XML tags; 
identifying referenced procedure calls that are specified within the XML tags; and 
locating resources specified within the XML tags. 

37. The medium of claim 35, wherein the obtaining step includes interpreting each XML tag 
based on at least one of execution of a prescribed routine corresponding to said each XML tag and 
referencing of a tag list that specifies a corresponding operation for said each XML tag. 

38. An application server comprising: 

a storage medium configured for storing extensible markup language (XML) documents 
having XML tags that define voice application operations for a voice application; and 

means for generating an output file that describes selected attributes of the voice application, 
generating means having a parser means for determining attributes of the respective XML tags 
within each of the XML documents according to the application runtime environment, and a context 
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means for storing the de ;ermined attributes, the generating means selecting the stored determined 
attributes based on a user selection. 

39. The application server of claim 16 5 wherein the generating means includes a tag 
implementation means for executing the respective voice application operations specified by the 
XML tags, the tag implementation means having an executable library configured for storing 
executable routines for a first group of the XML tags, and a tag list that describes the voice 
application operations for a second group of the XML tags, the parser means configured for 
determining the attributes based on the executable library and the tag list. 

40. The applicaion server of claim 39, wherein the generating means further includes a 
resources directory confi gured for identifying respective locations of resources specified in the XML 
documents, the parser means configured for determining the attributes based on the resources 
directory. 

41 . The application server of claim 40, wherein the resources are stored as voice prompts, 
each voice prompt havirg audio data and text data specifying contents of the corresponding voice 
prompt. 

42. The application server of claim 40, wherein the generating means further includes a 
procedures library configured for specifying executable procedures configured for generating 
respective procedure cells to prescribed external resources, the parser means configured for 
determining the attributes based on the procedures library. 

43. The application server of claim 42, wherein the context means includes: 

a resource collection table configured for storing the resources determined by the XML 
parser to be specified by a corresponding parsed XML document; 
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an executable procedures collection table configured for storing the executable procedures 
determined by the XML parser to be specified by the corresponding parsed XML document; and 

a next states collection table configured for storing possible next states of the voice 
application determined by the XML parser to be specified by the corresponding parsed XML 
document, the application runtime environment selecting the stored determined attributes from the 
resource collection table, the executable procedures collection table, and the next states collection 
table based on the user selection. 

44. The application server of claim 43, wherein the generating means further includes an 
output module configured for generating the output file as any one of a user prompt menu, a resource 
utilization table, and a call flow diagram, based on the user selection. 
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APPLICATION SERVER FOR SELF-DOCUMENTING 
VOICE ENABLED WEB APPLICATIONS DEFINED USING 
EXTENSIBLE MARKUP LANGUAGE DOCUMENTS 

ABSTRACT OF THE DISCLOSURE 
A unified web-biised voice messaging system provides voice application control between a 
web browser and an application server via an hypertext transport protocol (HTTP) connection on an 
Internet Protocol (IP) nei work. The application server, configured for executing a voice application 
defined by XML documents, also is configured for describing the voice application by collecting, 
for each of the XML documents, attributes describing execution of the XML documents in an 
application runtime environment, and generating for storage on a tangible medium an output file that 
describes the voice application based on at least a portion of the collected attributes selected by a 
user. Hence, the voice applications defined by XML documents can be considered as self- 
documenting, and the aci of writing the applications using XML documents generates the necessary 
information for creating and formatting documentation in accordance with the attributes (i.e., 
context) provided by the application runtime environment. 
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Program Hello World 
Function MenuOne { 

SpeakPromptToUser ("To say ^ello worldl,' press one. To say x 6oodbye worldl,' 

press zero.") ; 
Userlnput = GetlnputFromUser ("SingleDigit") ; 
If (Userlnput == "0") { 

SpeakPromptToUser ( "Goodbye World 1" ) ; 

FunctionCall [MenuTwo) ; 
} else if (Userlnput =="1") { 

SpeakPromptToUser ("Hello World!"); 

FunctionCall (MenuTwo) ; 
} else { 

SpeakPromptToUaer ("You have entered an incorrect number/ press one to say 

x Hello World!,' or press zero to say ^Goodbye World!'."); 
FunctionCall (MenuOne) ; 

} 

} 

Function MenuTwo { 

SpeakPromptToUser ("To try again, press one. To exit the application press 

two.") ; 

Userlnput = GetI:iputFromUser ("SingleDigit") ; 
If (Userlnput == "1") { 

FunctionCall (MenuOne) ; 
} else if (Userlnput =="1") { 

EXIT APPLICATION! 
} else { 

SpeakPromptToUser ("You have entered an incorrect number, press one to try 

again, or press two to exit the application") ; 
FunctionCall (tfenuTwo) ; 

} 

} 

Function Main { 

FunctionCall (MenuOne) ; 
_} 
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Initialize Application Runtime Environment, Load Runtime 
Variables (Resource Locators, Procedures Library Registration, 
XML Tag Implementation) 
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